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FOREWORD 


The  three  papers  which  this  interim  report  comprises  were  written  under 
Contract  AF  33(615)-2818  entitled  "Research  in  Experimental  Design  and 
Estimation  Theory*  "•  .  he  workj  which  Is  documented  under  Project  70*71* 
Research  in  Applwi  -vt  cheats  tics,  was  sponsored  by  Aerospace  Research 
Laboratories,  Ofr'i  >*•  of  Aeroanace  Research,  United  States  Air  Force, 
and  was  monitored  by  Dr.  H.  L.  Harter  of  these  Laboratories. 

The  first  paper,  entitled  "Construction  and  Comparison  of  Non-Orthogonal 
Incomplete  Factorial  Designs"  was  prepared  for  presentation  at  the 
Eleventh  Conference  on  the  Design  of  Experiments  in  Army  Research, 
Development,  and  Testing,  held  in  October  of  1965  at  Eoboken,  and  appears 
in  the  proceedings  of  that  conference.  The  second  paper  "Non-Orthogonal 
Designs  of  Even  Resolution,"  was  presented  at  the  annual  meeting  of  the 
American  Statistical  Association  at  Los  AngeleB  in  August  1966.  The 
third  paper,  "Saturated  Sequential  Factorial  Designs,"  represents 
simplification  and  generalization  of  work  contained  in  the  paper  "Designs 
for  Studying  One  Factor  at  a  Time"  which  was  presented  at  the  Berkeley 
meeting  of  the  Institute  of  Mathematical  Statistics  in  July  of  1965* 
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ABSTRACT 


This  report  consists  of  three  distinct  but  related  papers.  Experience  in  indus¬ 
trial  consulting  indicates  that  the  requirements  of  a  real  test  plan  often  differ 
from  textbook  examples  in  the  number  of  levels  for  the  factors,  the  interactions 
which  must  be  estimated,  and  the  total  number  of  runs  which  can  be  allocated  to 
the  experiment.  The  first  paper  is  concerned  with  methods  for  constructing  designs 
to  meet  such  requirements  and  with  criteria  for  selecting  a  design  from  a  number  of 
alternatives.  Various  construction  techniques  are  illustrated  by  examples.  Two 
specific  numerical  criteria  are  developed,  and  a  convenient  computer  routine  for 
evaluating  them  is  described.  Examples  of  designs  are  given  which  were  constructed 
for  actual  experiments. 

In  general,  designs  of  even  resolution  have  the  property  that  net  all  the  parameters 
are  estimable,  but  thoBe  of  primary  interest  are  estimable  with  none  of  the  remain¬ 
ing  parameters  as  aliases.  The  most  important  are  designa  of  resolution  4,  which 
are  such  that  the  main  effects  are  estimable  with  no  two-factor  interactions  as 
aliases.  In  the  second  paper  it  is  shown  that  the  smallest  resolution  4  designs 
for  n  factors  at  two  levels  must  contain  at  least  2n  runs,  and  that  "foldover" 
designs  are  available  with  2n  runs.  It  is  conjectured  that  the  only  minimal 
resolution  4  designs  are  foldover  designs.  The  case  of  resolution  6  designs  is 
also  discussed. 

Statistical  designs  which  vary  one  factor  at  a  time  are  inefficient  and  suffer 
from  lack  of  opportunity  for  randomization.  In  spits  of  these  deficiencies,  they 
may  be  useful  designs  early  in  experiments  because  they  yield  information  after 
each  run.  The  third  paper  gives  variance  bounds  for  estimates  of  main  effects 
using  one-at-a-time  designs,  and  characterizes  these  designs  which  achieve  the 


iii 


lower  bounds*  Situations  in  which  runs  are  conducted  a  block  at  a  time  (rather 
than  singly)  are  discussed.  Finally,  it  is  shown  that  inclusion  of  Interaction 
terms  in  the  model  iaproves  the  main-effect  estimates  of  factors  involved  in  the 
interactions. 
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Ci'hJ:rRUCTlON  AND  comparison  op  non-orthogonal 

INCOMPLETE  FACTORIAL  DESIGNS 


INTRODUCTION  AND  SUMMARY 

Very  often  in  industrial  research  an  experimental  program  mast  be  planned  for 
which  existing  fractional  factorial  designs  are  inadequate.  The  most  common 
reasons  for  this  inadequacy  are 

1)  the  available  designs  contain  too  many  runs, 

2)  the  factors  to  be  evaluated  in  the  experiment  do  not  all  appear  at  the 
same  numbers  of  levels,  and 

3)  the  particular  set  of  interactions  which  cannot  be  ignored  in  the 
analysis  of  the  experimental  results  does  not  appear  in  any  of  the 
published  designs. 

In  such  cases  the  consulting  statistician  may  have  a  tendency  to  try  to  alter 
the  thinking  of  the  experimenter  so  that  one  of  the  standard  published  designs 
can  be  used.  This  is,  of  course,  undesirable  from  the  experimenter's  point  of 
view  and  increases  the  probability  that  the  design  will  not  be  carried  out  as 
originally  planned.  As  an  alternative,  the  statistician  is  faced  with  the  prob¬ 
lem  of  developing  an  ad  hoc  test  plan  which  catisfico  the  actual  objectives  and 
constraints  of  the  real  situation.  Using  his  intuition  supplemented  by  a  meager 
amount  of  theory  he  must  come  up  with  a  design  with  satisfactory  statistical 
properties. 


CRITERIA  FOR  COMPARING  DESIGNS 

The  response  from  an  experiment  will  be  denoted  by  the  N-component  vector  Y, 
and  -ts  expected  value  by  EY  =  XfJ,  where  b  is  a  p-conponent  vector  of  para¬ 
meters.  Generally  speaking,  a  good  design  will  have  low  parameter-estimate 


variances,  which  are  proportional  to  the  diagonal  elements  of  (X'X)""*  *  For  a 
given  experimental  situation,  th.it  is,  specification  of  the  number  of  factors, 
numbers  of  levels  for  each  factor,  and  the  interactions  to  be  estimated,  a 
particular  finite  set  of  designs  is  available.  In  case  one  of  these  designs 
leads  to  the  minimization  of  the  variance  of  each  estimate,  then  there  is  no 
selection  problem.  This  does  not  often  happen,  however,  except  for  fractional 
factorials  with  all  factors  at  two  levels. 

In  rare  cares  the  relative  importance  of  the  parameters  to  be  estimated  nay  be 
known  quantitatively  well  enough  in  advance  so  that  a  realistic  criterion  can  be 
established  based  on  the  variances.  This  would  usually  take  the  form  of  a  weighted 
average  of  the  variances.  Most  often,  however,  the  relative  importance  of  esti¬ 
mating  the  parameters  with  low  variances  will  depend  on  their  as  yet  unknown 
values. 

A  criterion  for  selecting  the  design  often  proposed  is  the  generalized  variance, 
defined  as  the  determinant  of  (X'X)  1 .  A  confidence  set  for  the  parameters  is 
the  set  for  which  (,&~p)  (X'X)(p-g)  <  K.  The  volume  of  this  ellipsiod  is 

V  »  ^  K?P  , 

FTG-pVietU'X) 

which  is  seen  to  be  related  to  the  design  only  through  the  determinant  of  the 
cross-product  matrix.  It  is  convenient  to  consider  the  determinant  in  the  form 
of  en  index,  called  the  estimation  index,  defined  by 

IE  »  det(X’X)/(N?lf=1w, )  . 

The  weights  are  define.',  as  follows.  Let  Z  be  the  coefficient  matrix 

associated  with  the  full  factorial;  that  is,  if  T*  were  a  vector  of  responses 
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for  a  full  factorial  then  £Y*  =*  Zg,  (The  standard  parameterization  is  auch 

that  2’Z  ia  a  diagonal  matrix.)  Let  represent  the  i-th  diagonal  entry 

of  Z'Z  and  let  M  represent  the  total  number  of  runs  in  the  full  factorial. 

Then  w.  *  d./M  , 
x  i 

Often  the  purpose  of  an  experiment  ia  to  obtain  overall  information  about  the 
response.  In  these  cases  the  appropriate  criterion  is  based  on  the  average 
variance  of  a  fitted  response,  where  the  average  is  taken  over  all  M  points 
of  the  full  factorial.  The  average  variance  is  proportional  to  DrV.,  where 
the  are  the  diagonal  elements  of  (X’X)-1 .  A  convenient  representation  is 
through  the  "fitting  index" 

ij.  -  p/(ke?„,wiV  • 

Kore  generally,  an  index  could  be  based  on  the  integrated  variance  of  a  fitted 
response.  Such  an  index  would  in  general  involve  off-diagonal  elements  of 
(X'X)”1,  and  would  be  difficult  to  define  in  a  way  which  is  general  enough  for 
both  quantitative  and  qualitative  factors.  Experience  has  showed  Ip  to  be  a 
very  useful  index. 

Consider  the  class  of  models  which  is  "complete"  in  the  sense  that  if  any  inter¬ 
actions  between  a  pair  of  factors  appear  in  the  model,  then  all  interactions 
between  them  appear.  It  has  been  proved  [l]  that  for  models  which  are  complete 
in  this  sense,  the  maximum  value  of  both  I_,  and  Ip  is  unity.  In  [2]  it  is 
shown  that  the  maximum  is  achieved  if  certain  combinations  of  levels  appear  with 
equal  frequency.  An  equivalent  criterion  is  that  the  cross-product  matrix  X'X 
ia  proportional  to  the  cross-product  matrix  Z'Z  for  the  full  factorial.  All 
regular  fractional  factorials  have  this  property.  If  interaction  parameters  do 
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not  appear  in  complete  seta,  either  or  both  indices  may  be  greater  than  unity 


Thus  far  nothing  haa  been  said  about  the  parameterization  used  to  describe  the 
response,  that  is,  hovr  £  is  defined  in  terms  of  the  expected  responses  i.t  the 
various  treatment  combinations,  or  equivalently,  how  the  elements  of  the  X 
matrix  are  defined.  Since  the  parameterization  is  to  a  large  extent  arbitrary, 

&  particularly  appealing  property  of  the  two  indices  is  thut  they  are  invariant 
under  nonsingular  reparaaeterizations.  That  is,  suppose  EY  =  XB  =  XAw,  and 
similarly  EY*  =  Z&  =  ZAo,  ■  where  A  is  nonsingular.  It  can  be  demonstrated 
that  I?  and  I^,  are  identical  whether  calculated  under  the  parameterization 
£  or  <y.  Thus,  the  parameterization  is  immaterial  as  far  as  these  criteria 
are  concerned. 

Without  the  use  of  electronic  computers,  the  computation  of  the  indices  would 
be  extremely  tedious.  A  computer  code  has  been  written  for  routine  and  con¬ 
venient  'onparison  of  alternative  incomplete  factorial  designs.  A  detailed 
description  of  this  code  and  its  use  is  available  j.3],  Any  number  of  designs 
may  be  evaluated  simultaneously  by  reading  into  the  computer  the  treatment  com¬ 
binations  in  each.  The  evaluation  will  be  made  for  up  to  five  models  (specifi¬ 
cation  of  interaction  terms  to  be  included  in  the  model).  A  number  of  options 
is  available  to  the  user,  including  changing  the  parameterization  used  for  two-, 
three-,  or  four-level  factors,  or  changing  the  weights  used  in  computing  the 
indices.  A  Fortran  listing  is  included  in  reference  [?]. 
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METHODS  OP  CONSTRUCTIOH 


1 .  Exhaustive  Enumeration 

Por  a  few  simple  experimental  situations  it  is  feasible  to  enumerate  all  possible 
designs.  The  optimum  design  can  then  easily  be  chosen.  As  an  example,  consider 
as  an  experimental  situation  a  2^  in  5  runs  with  no  interactions.  There  are 
exactly  eleven  n^nsiagular  designs,  which  together  with  their  properties  are 
given  in  Table  I.  Clearly,  the  best  designs  are  the  eighth  and  ninth,  for  which 
each  variance  is  minimized. 


2*  One  Parameter  at  a  Time 

It  is  always  possible  to  construct  a  saturated  design  (although  they  are  very 

inefficient)  by  allocating  one  run  to  the  estimation  of  each  parameter.  For 
2  2 

example,  a  3  x  2  with  the  linear-by-1 inear  interaction  between  the  two  three- 


level  factors  is  as  follows 


0  0  0  0 
1  0  0  01 
2  0  0  0  J 

O'OOl 
0  2  0  0  J 
2  2  0  0 
0  0  10 
0  0  0  1 


mean 

effects  of  first  factor 

effects  of  second  factor 
interaction 

effect  of  third  factor 
effect  of  fourth  factor  , 


where  we  have  indicated  the  parameter  estimated  from  each  run.  The  fitting  and 
estimation  indices  are  .24  and  .025,  respectively. 
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EXHAUSTIVE  ENWIiRATIOM  OF  2  CUBED  IN  5  RUNS 
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3.  Correspondence 


The  theory  for  mixed  factorial  designs  is  less  well  developed  than  that  for 
designs  in  which  all  factors  appear  at  the  same  number  of  levels.  A  useful 
technique  is  to  construct  a  design  with  all  factors  at  the  same  number  of 
levels r  then  replace  some  of  the  factors  with  ones  of  real  interest  using 
a  fixed  correspondence  between  sets  of  levels.  The  best-known  examples  of 
this  technique  are  the  proportional-frequency  designs  of  Addeloan  [4].  To 
demonstrate  this  approach  consider  a  Oraeoo-Latin  Square  of  side  3. 

0  0  0  0 
0  111 
0  2  2  2 
10  12 
112  0 
12  0  1 
2  0  2  1 
2  10  2 
2  2  10 

The  last  two  factors  may  be  replaced  by  two-level  factors  by  using  the  corre¬ 
spondence 

0  -*  0 
1  ■*  1 

2-1 

which  results  in  the  design 


0  0  0  0 
0  111 
0  2  11 
10  11 
1  1  1  0 
12  0  1 
2  0  11 
2  i  0  1 
2  2  10 

This  design  is  quite  efficient,  having  a  fitting  index  of  .93  and  an  estima¬ 
tion  index  of  .79*  A  number  of  different  types  of  correspondences  is  given 
by  Addelman  in  [4]. 


f 
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4.  Permutation-Invariant  Deaims 

The  salient  property  of  permutation-invariant  designs,  defined  in  [5],  is  that 

estimates  involving  factors  which  appear  at  the  same  number  of  levels  have  the 

same  variance  properties.  More  formally,  the  cross-product  matrix  X'X  remains 

unaltered  if  factors  appearing  at  the  same  number  of  levels  are  permuted.  An 
2  3 

example  of  a  3  X  2  main  effect  design,  for  which  Ip  »  .80  and  Ig  »  .47,  is: 

0  0  10  0 
0  10  0  1 
0  2  0  1  0 
10  0  0  0 
11111 
12  111 
2  0  0  11 
2  1110 
2  2  10  1 

If  one  uses  a  standard  parameterlsation,  tbe  X  and  X'X  matrices  for 
this  design  are: 


\ 

* 


1 

£ 


9 
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1-1-1111-1 
1-1  01-2-1  -1 

1-1  111-1  1 

1  0-1-21-1  -1 

1  0  0-2-2  1  1 

1  0  1-211  1 
1  1-111-1  1 

1  1  0  1-21  1 

1  1  1111-1 


•1  ' 

1 

-1  ' 


-1 


1  |  .  (x*x) 


1  ' 


1  i 

l 

■i  ; 

t  i 


9  0  0  0  0  1  1  1 

06000222 
00600222 
0  0  0  18  0  -2  -2  -2 

0  0  0  0  18  -2  -2  -2 

1  2  2  -2  -2  9  1  1 

122-2-2191 

i  1  2  2-2-2  1  1  9 

*  — . 


Permutation  of  factors  appearing  at  the  same  numbers  Qf  levels  has  the  effect  of 
permuting  rows  and  columns  of  the  submatrices  in  the  partitioned  cross-product 
matrix.  Since  the  submatrices  are  invariant,  the  design  is  permutation-invariant. 


This  principle  has  been  used*  to  construct  a  series  of  as  yet  unpublished  satu¬ 
rated  second-order  designs  for  three-level  factors.  For  five  factors  the  design 
contains  the  treatment  combination  00000.  the  five  treatment  combinations 
which  are  permutations  of  1  1  1  1  0,  the  five  permutations  of  2  2  2  2  0,  and 
the  ten  permutations  of  2  2  0  0  0.  For  this  design  the  fitting  index  is  .66 
and  the  estimation  index  is  2.35.  Relative  to  the  full  factorial  but  adjusting 
for  the  difference  in  the  number  of  runs,  the  efficiency  of  the  estimate  of  the 
mean  is  82#,  of  the  linear  main  effects  is  114#,  of  the  quadratic  main  effects  is 
25#,  and  of  the  linear  by  linear  interactions  is  171#.  The  reason  that  the  linear 
effects  and  interactions  are  so  efficient  is  that  the  points  of  the  design  tend 
to  be  concentrated  around  the  outside  of  the  hypercube. 


•This  work  was  carried  out  by  R.  L.  Rechtschaffner  of  Rocketdyne’s  Statistical 
Test  Design  Unit. 
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5.  Balancing  Levels 

A  very  useful  technique  for  constructing  designs  is  to  start  with  an  ordinary 
factorial  structure  for  the  first  group  of  factors,  and  then  insert  the  remain¬ 
ing  factors  in  such  a  way  that  pairs  of  levels  appear  together  with  nearly  equal 
frequencies.  For  example,  the  following  two  designs  are  obtained  by  adding  another 
two-level  factor  to  a  basic  2x3  full  factorial: 


Design  1 

Design  2 

0  0  0 

0  0  0 

0  1  1 

0  1  1 

1  0  1 

1  0  1 

1  1  0 

1  1  1 

2  0  0 

2  0  1 

2  1  1 

2  1  0 

Their  variance  properties  are  given  in  Table  11. 

EXAMPLES 

Three  ad  hoc  designs  which  have  been  used  successfully  at  Rocketdyne  will  be 

mentioned  briefly.  The  first  involved  determination  of  char  formation  rate  in 

ablative  heat-shield  material  under  simulated  reentry  conditions.  The  testing 

was  done  in  a  small  stationary  hydrogen-oxygen  rocket  engine.  The  experimental 

variables  were  rocket  engine  combustion  chamber  pressure,  propellant  mixture 

ratio,  and  the  angle  of  the  sample  in  the  rocket  exhaust.  The  experimental 

3 

design  chosen  was  one  of  ihe  optimum  2  designs  in  5  runs  discussed  earlier. 
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3X2X2  'BALANCED*  DESIGNS 
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1  1 

170 

i  4 

j  0 
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250 
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1 
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170 

,  16 

1 

4 

250 

!  16 
» 

\  0 
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250 
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Another  such  design  was  used  on  a 

Signal  Corps 

battery  program.  The  experimental 

work  involved  screening  4 

cathode 

materials,  3 

solvents,  and  4  salts.  The  design 

was  constructed  by  balancing  the 

levels  of  the 

second  four-level  factor  within 

the  framework  of  the 

12-run  3  X  4 

factorial. 

Run 

Number 

1  Cathode 

\ 

i 

t  Solvent 

Salt 

1 

i 

!  o 

i 

0 

0 

2 

i 

i  0 

1 

1 

3 

!  0 

2 

3 

4 

1 

0 

1 

5 

1 

1 

0 

6 

1 

2 

2 

7 

2 

0 

2 

8 

2 

1 

3 

9 

2 

2 

!  1 

10 

* 

f  0 

;  3 

11 

3 

1 

2 

12 

j 

2 

0 

Although  there  was  no  justification  for  assuming  interactions  did  not  exiBt,  they 
could  reasonably  be  expected  to  be  less  important  than  main  effects.  It  vas 
intended  that  this  experiment  be  used  to  eliminate  from  contention  some  of  the 
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candidate  materials  with  just  a  few  tests,  so  that  later  testa  could  concentrate 
on  the  better  ones.  The  actual  decision  nade  frost  these  tests  was  th.it  none  of 
the  four  cathode  materials  was  satisfactory,  and  later  testing  should  be  directed 
at  finding  additional  materials.  If  all  interactions  r  u  been  considered,  43 
testa,  using  these  four  unsatisfactory  materials,  would  have  besn  required. 

4  3 

Tne  balancing  technique  K«a  used  effectively  to  construct  a  3  x  2  design  in  27 
runs  for  a  program  concerned  with  the  evaluation  of  fiber- reinforced  plastic 
laminates.  The  variables  are  as  follows: 
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NON-QRTHOGONAi  DESIGNS  OP  EVEN  RESOLUTION 


INTRODUCTION  AND  SUMMARY 

Incaoplete  factorial  designs  for  estimating  all  main  effects  or  all 
main  effects  and  all  two- factor  interactions  have  received  cons lde rah le 
treatment  in  the  literature.  An  intermediate  category,  which  has  re¬ 
ceived  much  less  attention,  contains  designs  from  which  the  main  effects 
can  be  estimated  unbiased  by  two-factor  Interactions,  but  the  inter¬ 
actions  themselves  cannot  be  estimated.  Such  designs,  said  to  be  of 
resolution  4,  are  the  moat  important  of  the  designs  of  even  resolution, 
and  consequently  receive  the  most  attention  in  this  paper* 

Within  the  more  restricted  class  of  fractional  factorials,  properties 
and  construction  technique  for  designs  of  all  resolution  numbers  are 
well  known.  Such  designs  may  be  constructed  immediately  from  a  defining 
contrast,  in  which  case  the  resolution  is  equal  to  the  minimum  number 
of  letters  in  the  elements  of  this  contrast.  An  effect  of  order 
q  (q  «  0  for  the  grand  mean,  q  «  1  for  main  effects,  etc.)  in  a  frac¬ 
tional  factorial  design  of  resolution  r  has  as  aliases  terns  of  order 
r  -  q  and  higher. 

Outside  of  the  family  of  fractional  factorials,  as  one  might  expect,  the 
situation  is  not  as  straightforward.  The  following  definition  of  reso¬ 
lution  for  such  designs  was  provided  in  Cl):  a  design  of  odd  resolution 
r  is  such  that  all  effects  through  order  $(r-l)  are  estimable  ignor¬ 
ing  higher  order  terms;  a  design  of  even  resolution  r  is  such  that 
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i 

■S' 

i 

effects  of  order  £(r-2)  or  lower  are  estimable  ignoring  those  of  order  : 

£(r  +  2)  or  higher.  For  design  of  even  resolution  those  effects  of 
order  ^  r  are  not  estimable  but  do  not  appear  &s  aliases  of  those 
which  are. 

The  analysis  of  designs  of  odd  resolution  is  straightforward .  The 
ordinary  least-squares  technique  is  used  to  estimate  0  ,  the  vector 
of  parameters.  Letting  EY  ■  X  0,  where  Y  is  the  vector  of  responses 
from  a  design,  we  have  0  s  (x'x)'1x'y  ,  and  Var  I  »  (x'x)"1^2.  A 
design  is  of  the  required  resolution  if  and  only  if  the  corresponding 
cross-product  matrix  x' X  is  nonsingular.  A  necessary  condition  is 
that  the  number  of  runs  H  be  at  least  as  large  as  the  number  of  para¬ 
meters. 

This  paper  reviews  previous  work  on  designs  of  even  resolution.  The 
estimation  theory  for  such  designs  is  developed.  It  is  proved  that  a 
2n  design  of  resolution  4  contains  at  least  2n  runs.  The  method  of 
proof  gives  insight  into  the  structure  of  minimal  designs  of  resolution  4, 
and  leads  to  a  characterization  of  resolution  4  designs.  The  "foldover 
principle,"  due  to  Box  and  Wilson  [2],  is  discussed  in  detail,  and  it  is 
shown  thit  this  principle  may  be  used  to  generate  minimal  designs  of 
resolution  4.  It  is  conjectured  that  the  only  minimal  designs  of 
resolution  4  are  foldover  designs.  Designs  of  resolution  2  and  6  are 
discussed  briefly. 

} 

i 

* 
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PREVIOUS  WORK 


References  to  fractional  factorials  of  even  resolution  are  scattered 
throughout  the  standard  literature  (for  example,  [>J,  and  [4]). 

The  first  cocp  rehens ive  treatment  of  such  designs  was  given  by  Box  and 
Hunter  [5  3,  who  introduced  the  tern  "resolution."  They  showed  that  eight 
factors  could  be  accomodated  in  16  runs  ,  twelve  in  24  runs,  and  in 
general  4k  factors  in  8k  runs.  The  designs  are  constructed  by  the 
"foldover"  principle  from  saturated  resolution  3  (Flackett-Burnan) 
designs  which  exist  if  the  number  of  factors  is  of  the  form  4k-l  for 
k  *  23  C63.  This  principle  can  best  be  described  by  means  of  the  design 
matrix  for  a  Plackett-Burman  design;  for  example,  consider  the  2^  in 
4  runs; 

0  0  0 
Oil 
10  1 
_1  1  OJ  . 

The  ''mirror-'  image  of  this  matrix  is  formed  by  interchanging  0  and  1  j 
in  the  example  we  have; 

1  1  f 
10  0 
0  10 
0  0  lj  . 

The  completed  foldover  design  consists  of  the  original  design  and  its 
"image"  as  submatrices,  augmented  by  a  new  factor  at  its  high  level  in 
the  first  half  and  its  low  level  in  the  second.  In  the  example  being 
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considered,  the  complete  2*  resolution  4  design  in  8  runs  is 

'1  0  0  0' 

10  11 
110  1 
1110 
0  111 
0  10  0 
0  0  10 

0  0  0  1  . 

L,  J 

Box  and  Wilson  1.2]  provide  a  proof  that  the  foldover  procedure  yields 
designs  with  the  property  that  first-order  effects  (i.e.,  main  effects) 
have  no  second-order  effects  (interactions)  as  aliases.  Although  this 
is  proved  in  the  context  of  response  surface  experiments,  it  ia  equally 
valid  for  incomplete  factorials  and  is  proved  in  this  context  in  a  sub¬ 
sequent  section.  An  even  simpler  proof  is  available  if  the  initial 
design  is  a  fractional  factorial.  For  the  first  half  of  the  design  the 
defining  contrast  contains  the  first  factor  A  plus  additional  terms 
none  of  which  has  fewer  than  three  letters.  In  the  second  half  the  alias 
structure  ia  the  3ame,  except  that  all  elements  of  the  defining  contrast 
with  an  OvJ  number  of  letters  have  their  sign  changed.  The  defining 
contrast  of  the-  entire  design,  obtained  by  adding  those  of  the  subdesigns, 
contains  only  terms  containing  an  even  number  of  letters,  all  with  four  or 
more.  In  the  present  example  the  defining  contrasts  are  I  *  A  *  -BCD  = 
-ABCD  and  I  *  — A  =  BCD  =  -ABCD  for  the  subdesigns  and  1  *  •ABCD  for 
the  whole* 

An  alternative  procedure  for  constructing  fractional  factorials  of 
resolution  4  Is  also  given  by  Box  and  Hunter.  Starting  from  a  full 
factorial  involving  a  subset  of  the  factors,  new  factors  are  included 
by  eiuating  them  to  interactions  involving  an  odd  number  of  the  original 


factors 


h 

•  For  example,  to  a  complete  2  can  be  added  E  *  ABC, 

F  •  ABD,  0  >■  ACD,  and  H  *  BCD,  to  complete  the  eight-factor  16-run 
resolution  4  design. 

Recent  unpublished  work  by  Cuthbert  Daniel  [7]  motivated  me  to  initiate 
the  study  which  resulted  in  this  paper.  He  showed  that  nan-orthogonal 
resolution  4  designs  exist  and  gave  minimal  designs  for  3  factors  in 
six  runs  and  for  5  factors  in  10  runs.  Scrutiny  of  Daniel's  designs 
reveals  that  they  may  be  considered  as  having  been  constructed  from 
minimal  resolution  3  designs  by  the  foldover  technique. 

estimation  in  EVKM- resolution  designs 

Ordinarily  from  a  model  of  the  form  EY  «=  X{3  one  can  obtain  the  least- 
squares  estimate  of  B,  which  is  given  by  8  *  (X*X)  1  X*Y.  In  even- 
resolution  designs  the  matrix  XX,  however,  is  singular  so  that  this 
procedure  is  not  applicable.  Let  the  model  be  rewritten  in  the  form 
EY  »  +  *2®2  +  X3^3’  where  ^  N  x  1  vector  of  responses, 

B^  is  the  p  x  1  vector  of  parameters  to  be  estimated,  and  82  and 
are  respectively  q  x  1  and  r  x  1  vectors  of  parameters  which  are  not 
to  be  estimated.  Furthermore,  let  the  selection  of  the  parameters  in 
the  vector  82  be  such  that  the  matrix 
Since  this  matrix  is  of  full  rank,  there  must  exist  matrices  and  H2 

such  that  Xj  can  be  expressed  in  the  form  X,  «  X 


iHi  +  xzV 


Cx^,  Xg  3  is  of  full  rank  p  +  q. 
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the  requirement  that  the  design  be  of  even  resolution  it  can  be  shown 
that  the  matrix  must  be  zero.  Let  g^  be  given  by  J  Y.  We 

have  E  g^  =  0^  which  can  be  rewritten 

E  JY*  J  (X-^  +  X2e2  +  X^gj)  «  gx. 

Therefore  we  must  have  JX^  -  X,  JX2  «  0,  and  JX^  «  0.  But 

JXj  »  JXA  +  JXgHg  “  +  ®2  “  ai>  so  *****  Hi  BUSt  ^  tiie  2ero 

matrix. 


Analysis  of  even  resolution  designs  can  be  facilitated  by  an  appropriate 
partitioning  of  the  unestimated  parameters  into  0  and  g  .  Let  X*X 
be  written  in  the  form 


x’x 


A  B  D 
B*  C  F 
D*  F'  G 


where  the  partitioning  corresponds  to  that  of  X  into  X^,,  and  X^. 

The  normal  equations  may  now  be  expressed  in  the  fora 
A  g1  +  B  g2  +  D  -  X[  Y 

-X2  Y 


B  ^  +  C  g2  +  F  05 
d’Pi  +  F*i2  +  G  »  Xj  Y 


By  the  assumptions  made  previously,  the  matrix  : B» c 


Fa.b 


Is  non singular; 


let  its  inverse  be  given  by 
partitioned  matrices  we  have 


U  V 

v'w 


.  By  the  usual  rules  for  inverting 
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‘5 

4 

-1 


4 


U  -  (A.  -  Be'1  s')"1 

V  •  *11  B  C"1 

v  «  c*1  -c‘L  b’v. 

A  particular  solution  to  the  normal  equations  is  given  by 

\ 

^■UX^Y+VXgY 

%z  *  v*  xi  Y  +  w  x2  Y 


'Oils  may  easily  be  verified  by  substituting  this  solution  back  into  the 
normal  equations .  By  the  def initial  of  estimability  of  0^,  every 

a 

solution  of  the  normal  equations  has  the  same  value  for  that  is, 
its  value  is  independent  of  the  way  in  which  the  unestimated  parameters 
are  partitioned  into  Bg  and  Bj. 

MINIMAL  RESOLUTION  4  DESIGNS 

The  development  in  the  Last  section  can  be  used  in  proving  that  the 
smallest  resolution  k  designs  for  n  factors  must  contain  at  least  2n 
runs.  The  proof  is  accomplished  by  shoving  that  certain  interaction 
parameters  must  be  in  the  vector  since  under  the  assumption  that 
■  0,  B^  and  &2  are  Jointly  estimable . 

THEOREM  1*. 

A  resolution  4  design  for  n  factors  at  tvo  levels  must  contain  at 
least  2n  runs . 

* 

Barry  Margolin.  Harvard,  independently  developed  an  identical  proof 
for  this  theorem. 
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PROOF 


Let  X..  ....  X  be  the  column  vectors  of  the  matrix  X  associated 
j .  n 

with  the  n  main  effects.  Let  Z^,  . ..,  ZQ  represent  the  column 

vectors  associated  with  the  grand  mean  and  the  Interactions  of  the  first 

factor  with  the  second,  third,  ...,  n-th,  in  that  order.  Note  that 

z^y  the  i-th  component  of  Z^t  is  given  by  z^  =■  x^  x^,  where  x^  is 

ttm  i-th  component  of  xj*  Since  main  effects  are  estimable,  X^,  ...,  XQ 

are  linearly  independent.  Because  of  the  nature  of  the  Z^'s  it 

follows  that  the  Z.'s  are  also  mutually  independent.  It  will  now 
J 

be  shown  that  the  requirement  that  the  design  be  of  resolution  4  implies 
that  the  X*s  and  Z*s  are  also  independent  of  one  another. 

Suppose  the  design  contains  N  <  2n  runs .  Select  any  vectors 

W, ,  ...,  W„  such  that  Cx, ,  ....  X  .  V, ,  ....  W„  ]  is  of  full  rank  N. 
1'  N-n  1'  *  n'  1'  N-n 

Since  the  design  is  of  resolution  4  all  the  Z  s  are  expressible  in  the 
form  Z  »  XH^  +  WH.,,  using  the  obvious  definitions  of  the  matrices 
Z,  X,  and  W.  Since  the  matrix  must  be  equal  to  0,  Z  *  WHgj  but 

there  are  more  linearly  independent  Z’6  than  W's,  which  is  a  con¬ 
tradiction. 

Essentially  the  same  proof  can  be  used  to  give  a  characterization  of 
resolution  4  designs. 
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TKEGR2.M  2  . 

In  addition  to  the  min  effects,  the  grand  mean  and  all  two-factor  in¬ 
teractions  involving  a  given  factor  can  be  estimated  from  a  resolution  k 
design  under  the  assumption  that  the  remaining  interactions  are  zero. 
Conversely,  if  it  is  true  that  for  each  choice  of  a  single  factor  all 
two-factor  interactions  involving  it,  the  grand  mean,  and  main  effects 
are  estimable  ignoring  the  remaining  interactions,  then  the  design  is  of 
resolution  4. 

PROOF. 

In  the  preceding  proof  it  was  shown  that  in  any  resolution  k  design  the 
vectors  Lx^,  •  ■ Xq,  Z^,  Z^]  are  mutually  linearly  independent. 

Since  the  designation  of  which  factor  was  used  to  define  the  Z's  was 
arbitrary,  the  first  part  of  this  theorem  follows. 

To  prove  the  converse,  let  zjj^,  ...,  be  the  column  vectors 

associated  with  the  grand  mean  and  two-factor  interactions  involving 
the  first  factor;  •••>  Z^  be  associated  with  the  grand  mean 

and  two-factor  interactions  involving  the  secorai  factor; 

...  ;  Z^n^,  ...,  Z^Qy  be  associated  with  the  grand  mean  and  two-factor 
interactions  involving  the  n-th  factor.  The  hypothesis  is  that  for 
each  choice  i  the  vectors  LX^,  ...,  XQ,  Z^"}  ...,  zj^  J  are  mutually 
linearly  independent.  Therefore  the  space  spanned  by  the  set 
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...,  ...,  2^n^,  ...»  Z^J  is  independent  of  that  epanned 

x  ft  a.  ft 

by  the  X'a.  Select  any  basis  for  the  former  eubepace  and  assign  the 
corresponding  parameters  to  the  vector  p^.  The  column#  for  the  re¬ 
maining  parameters  are  all  expressible  as  linear  combinations  of  those 
in  the  basis,  so  that  the  matrix  is  sero,  which  in  turn  implies 

that  the  design  is  of  resolution  4. 

Although  the  characterization  of  resolution  4  designs  provided  by  this 
theorem  is  not  particularly  useful  for  verifying  whether  or  not  a  given 
design  is  of  resolution  4,  it  does  have  the  following  corollary, 

COROLLARY. 

Augmenting  a  design  of  even  resolution  by  additional  treatment  combina¬ 
tions  does  not  reduce  the  resolution  number. 

Although  this  corollary  appears  trivially  obvious,  a  direct  proof  with¬ 
out  using  Theorem  2  is  frustratingly  involved. 

THE  FOLDOVER  PRINCIPLE 

The  foldover  principle,  described  above,  can  be  used  to  generate  a  wide 
variety  of  designs  of  even  resolution.  If  a  design  is  of  resolution  3% 
the  foldover  design  made  from  it  is  of  resolution  4.  A  proof  in  the 
context  of  2P  designs  is  as  follows J 

Suppose  U  is  the  coefficient  matrix  for  a  resolution  3  design.  The 
coefficient  matrix  for  the  foldover  design  is  of  the  form 
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where  e  is  an  appropriately  dioena ioned  vector  of  l's.  Tbe  coeffi¬ 
cient  vectors  for  the 'main  effects  are  in  the  U  port  of  the  parti¬ 
tioned  matrix,  and  those  for  two- factor  interactions  are  in  the  V  part. 
The  negative  of  appears  in  the  second  half  of  the  design  by  defini¬ 
tion  of  the  foldover  principle .  In  the  first  half,  each  element  of  a 
colton  of  V  is  the  product  of  the  corresponding  elements  in  two 
columns  of  U;  in  the  second  half,  the  matrix  V  is  diqalicated  since 
the  negative  of  each  column  of  U  is  involved.  The  cross-product 
matrix  is 


Z  e'e 


2  e*V 


liv’e 


X'X  »  j  0  2  U'U  0 

0  2  V*V  '  • 

Since  the  main-effect  part  2U'U  of  this  matrix  Is  nonsingular  and 


orthogonal  to  the  remainder,  the  design  is  in  fact  of  resolution  4. 
Thus,  for  foldover  designs  the  subspace  spanned  by  the  collects  asso¬ 
ciated  with  the  main  effects  (the  vectors  X^,  ...,  XQ  in  the  notation 
of  the  previous  section)  is  not  only  independent  of  but  also  orthogonal 
to  the  subspace  spanned  by  the  remaining  columns  (the  vectors 


The  foldover  technique  may  be  employed  on  n-run,  (n-l)  -factor  designs 
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of  resolution  3  to  yield  2n-nm,  n-factor  designs  of  resolution  4 . 

By  Theorem  1,  such  designs  will  be  the  saallest  possible  designs  for 
this  experimental  situation.  Designs  which  are  alniawil  and  which  appear 
to  be  among  the  most  efficient  possible  are  given  below*  Only  half  the 
treatment  combinations  are  given  for  each  design,  the  other  half  being 
obtained  by  "multiplying"  In  the  usual  fashion  each  of  the  listed 
treatment  combinations  by  the  treatment  combination  with  all  factors  at 
their  high  level.  The  first  design  is  due  to  Daniel  I7  ].  Fractional 
factorials  are  available  for  4  and  8  factors.  In  the  column  labeled 
"variance"  Is  given  the  multiple  of  giving  the  variance  of  each 

main-effect  estimator. 


Hurber 
of  Factors 

Ember 
of  runs 

Variance 

Runs  in  Half 
of  Design 

5 

6 

1/4 

a,  b,  c 

5 

ID 

V9 

a,  b,  c,  d,  e 

6 

12 

1/10 

ab,  ac,  be,  d,  e,  f 

7 

14 

ll/lOO 

a,  b,  c,  d,  e,  f,  g 

3ased  on  the  work  to  date  with  non-orthogonal  designs  of  resolution  4, 
the  following  conjecture  is  made. 


CONJECTURE  . 

n 

Fold over  designs  form  a  complete  class  of  minimal  2  designs  of  reso¬ 
lution  4.  That  is,  there  exist  no  resolution  4  designs  with  2n  runs 
and  n  factors  except  those  constructed  by  the  fold  over  technique. 
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3,  and  4.  For  the  case  of 


The  conjecture  has  been  proved  for  n  a  2, 
two  factors  the  only  resolution  4  design  Is  the  full  factorial,  which  is 
itself  a  foidover  design.  For  three  factors  it  is  relatively  easy  to 
enumerate  all  possible  six-run  designs  and  note  that  the  only  designs 
of  resolution  4  are  foidover  designs.  For  the  case  of  four  factors  a 
proof  that  the  only  resolution  4  designs  are  foidover  designs  has  been 
constructed .  In  order  to  prove  this  result,  consider  the  submatrix 
consisting  of  the  columns  of  X  associated  with  the  parameters 
I,  AB,  AC,  and  AD.  There  are  eight  possible  combinations  of  values  for 
the  elements  in  the  rows  of  this  submatrix .  In  the  X  matrix  the 
elements  of  the  columns  of  X  associated  with  BC  are  simply  the  product 
of  the  elements  in  the  columns  AB  and  AC.  If  a  design  is  of  resolu¬ 
tion  4  then  the  elements  of  BC  must  also  be  linear  combinations  of  the 
elements  of  the  four  columns  I,  AB,  AC,  and  AD.  Under  these  restric¬ 
tions  only  four  of  the  eight  possible  combinations  of  values  for 
AB,  AC,  and  AD  may  appear  in  the  design.  This  fact  in  turn  implies 
that  the  design  must  be  a  foidover  design. 

DESIGNS  OF  OTHER  RESOLUTION  NUMBERS 

A  design  of  resolution  2  is  such  that  an  estimate  of  the  grand  mean  is 
available  which  is  unbiased  by  main  effects.  For  any  number  of  factors, 
such  a  design  lx  provided  by  any  two  runs  which  are  cocq?  lenten  tary,  in 
the  sense  that  each  factor  appears  at  its  high  level  in  one  and  at  its 
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low  level  la  the  other.  The  variance  of  the  estimated  grand  mean  is 
£  a  using  any  such  design.  Such  designs  are  the  only  minimal  designs 
of  resolution  2,  and  nay  he  considered  as  fuldovar  designs. 

Fractional  factorials  of  resolution  6  may  be  constructed  by  the  rold- 
over  principle  from  fractional  factorials  of  resolution  5 •  The  argument 
involving  defining  contrasts  given  in  an  earlier  section  for  designs  of 
resolution  4  is  easily  extended  to  encompass  this  situation.  Indeed, 
the  foldover  principle  can  be  used  to  construct  a  design  of  any  even 
resolution  number  from  a  fractional  factorial  of  the  next  lower  (odd) 
resolution  number.  The  resulting  designs  are,  of  course,  also  fractional 
factorials . 

The  foldover  principle  may  be  applied  to  more  general  designs  of 
resolution  5,  hut  the  result  need  not  satisfy  the  definition  of  a  de¬ 
sign  of  resolution  6  given  in  the  first  section  of  this  paper.  Let 
the  coefficient  matrix  for  a  foldover  design  constructed  from  a  resolu¬ 
tion  5  design  be  represented  by 


Here  the  U  part  corresponds  to  main  effects,  V  to  two-factor  inter¬ 
action,  and  W  to  three-factor  interactions.  CHie  cross-product  matrix 


2  e'e 


0 


2  e*v 


0 


x*x  » 


0 

2  ¥*e 

0 


2  0*0 
0 

2  M’U 


0 

2  ?*▼ 
0 


2  U'W 
0 

2  W*W 


It  is  clear  that  estimates  of  the  grand  rean  and  of  the  two-factor 
interactions  are  available  which  are  unbiased  by  three-factor  inter¬ 
actions.  The  estimates  of  the  main  effects  will  in  general*  however* 
have  three-factor  interactions  as  aliases.  In  order  not  to  have  such 
aliasing,  the  columns  of  V  must  be  linearly  independent  of  those  for 
0. 


Outside  the  class  of  fractional  factorials  nothing  appears  to  be  known 
about  designs  which  are  truly  of  resolution  6  (that  is,  for  which  both 
two-factor  interactions  and  main-effects  have  no  three-factor  interac¬ 
tions  as  aliases),  in  argument  analogous  to  Theorem  1  can  be  used  to 

show  that  the  minimum  number  of  runs  in  such  a  design  is  1  +  (ng^) 

o 

n  -n+2.  For  three  factors  the  only  design  of  resolution  6  is  the  full 
factorial  (which  is  of  resolution  7).  For  four  factors  there  is  avail¬ 
able  a  15- run  design  of  resolution  7,  but  there  does  not  seem  to  be  a 
14-run  design  of  resolution  6.  It  is  not  known  whether  there  exists  a 
five-factor  design  of  resolution  six  containing  between  22  runs*  the 
■inlw  by  the  above  formula*  and  26  runs,  the  minimum  number  for  a 
resolution  7  design.  For  the  case  of  six  factors,  the  half-replicate 
is  a  minimal  resolution  6  design. 
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saturated  sequential  factorial  designs 


INTRODUCTION  AND  SUMMARY 

In  the  early  phases  of  an  experimental  investigation,  the  experimenter  may  be 
unaware  or  have  only  a  general  idea  of  soase  of  the  variables  which  have  important 
influences  on  the  important  responses.  Typically  he  will  reject  the  apparent 
rigidity  of  a  formal  statistical  teat  plan  and  do  exploratory  experimentation.  The 
result  of  such  experimentation  may  well  be  a  sequence  of  runs  each  of  which  intro¬ 
duce  a  new  variable  or  a  new  level  for  an  old  variable. 

It  has  become  axiomatic  in  the  statistical  experimental  design  literature  to 
discourage  the  practice  of  varying  one  factor  at  a  time.  For  the  case  of  factors 
each  at  two  levels,  an  excellent  exposition  of  the  statistical  arguments  against 
such  designs  was  given  by  Fisher  in  The  Design  of  Experiments.  Sections  37  and  38  10* 
He  bases  his  attack  on  the  fact  th.-.t  the  variances  of  the  main-effect  estimates  using 
such  designs  are  considerably  larger  than  with  orthogonal  designs,  and  on  their  lack 
of  information  about  interactions. 

On  the  other  hand,  the  experimenter  often  likes  such  designs  because  he  finds 
out  more  rapidly  whether  a  new  factor  hus  any  effect.  He  continually  receives 
information  rather  than  having  to  wait  till  the  entire  experiment  is  completed.  If 
the  magnitudes  of  the  effects  he  is  interested  in  are  several  times  as  large  as 
experimental  error,  if  he  does  not  need  to  describe  these  effects  precisely,  and  if 
there  are  no  interactions,  there  is  no  particular  disadvantage  in  experimenting  in 
this  way.  Cuthbert  Daniel  [2]  has  presented  these  positive  aspects  of  such  designs, 
and  pointed  out  that  they  can  often  be  augmented  to  form  a  half  replicate  plus  one 
additio.'-al  run,  in  which  case  the  lost  efficiency  is  for  the  most  part  regained. 


In  an  earlier  paper  [5]  I  introduced  the  concept  of  contractible  designs, 
which  have  the  property  thnt  much  of  -he  information  in  the  experiment  will  be  avail¬ 
able  even  if  the  experiment  in  prematurely  halted  or  the  course  of  the  experiment  is 
significantly  altered.  Gne-at-a-tisse  designs  represent  an  extreme  class  of  contract¬ 
ible  designs,  in  that  some  information  is  available  no  matter  when  the  experiment  is 
terminated. 

The  first  few  sections  of  this  paper  develop  a  theory  for  one-at-a-time  designs 
for  estimating  the  main  effects  of  two-level  factors.  It  is  shown  that  io  is  a 
lower  bound  for  the  variance  of  a  main-effect  estimate  from  a  saturated  one-at-a- 
time  design.  (This  result  was  previously  given  in  [4].)  A  characterization  of 
designs  for  which  the  lower  bound  is  achieved  is  presented.  Th*  results  on  two- 
level  factors  are  extended  to  the  case  in  which  there  1b  no  restriction  on  the  num¬ 
bers  of  levels  for  the  factors.  Situations  may  arise  in  which  the  factors  can  safely 
be  introduced  in  small  sets,  rather  than  one  at  a  time.  Details  are  derived  for 
block  sizes  of  2,  3,  and  4.  Finally,  inclusion  of  interaction  terms  in  the  model  is 
considered.  It  is  shown  that  the  estimates  of  main  effects  of  factors  involved  in 
interactions  are  improved. 

variance  bounds  for  one-at-a-time  designs  for  two- level  factors 

The  first  run  of  a  one-at-a-time  design  has  all  factors  at  their  initial  levels, 
which  for  convenience  will  be  considered  the  low  levels,  denoted  by  0  or  -1 .  Each 
successive  run  introduces  the  high  level,  denoted  by  1  or  +1 ,  of  one  of  the  factors. 
The  factors  will  be  considered  as  being  ordered  in  such  a  way  that  the  ith  factor 
first  appears  at  its  high  level  in  the  ( i+1 )et  run.  After  a  factor  has  been  intro¬ 
duced  (i.e.,  after  it  appears  for  the  first  time  at  its  high  level)  it  may  stay  at  its 
high  level,  revert  to  its  low  level,  or  be  varied  between  its  two  levels  on  subsequent 
tests.  Thus  there  is  a  wide  latitude  of  possible  one-at-a-time  designs. 
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Experiments  for  estimating  the  main  effects  of  two-level  factors  are  conven¬ 
tionally  analysed  in  terns  of  the  coefficient  matrix  X  as  follows.  The  first 
column  of  X  corresponds  to  the  grand  mean  and  has  all  its  components  equal  to  1 . 

Each  of  the  remaining  columns  corresponds  to  one  of  the  factors,  and  each  row  corres¬ 
ponds  to  s  run.  According  to  whsther  a  given  factor  is  at  its  high  or  low  level  in  a 
given  run.  the  corresponding  element  of  X  contains  the  entry  +1  or  -1 . 

Suppose  a  vector  T  of  H  responses  is  obtained  from  the  experiment.  Under 
the  assumption  that  there  are  no  interactions  we  may  write  ¥  =  XB  +  e,  where  B  is 

the  vector  of  the  unknown  parameters  and  e  is  a  vector  of  independent  random  errors 

2  *■ 

having  mean  zero  and  common  variance  o  .  The  least-squares  estimate  B  of  R 
is  0  -  (X*X)~*X*¥  .  The  covariance  matrix  of  0  is  o2(x,X)~<  . 

In  addition  to  working  with  the  traditional  coefficient  matrix  X,  it  will  be 
convenient  to  introduce  a  reduced  matrix  R  .  Where  X  has  an  element  1 ,  R  also 
has  t;  where  X  has  a  -1 ,  R  has  a  zero.  It  may  be  verified  that  X  and  R 
are  related  through  the  triangular  transformation  matrix  T  according  to  the  equation 
X  -  ST.  as  in  the  following  examples 


tm  « 

-1  - 

1 

-1 

-t 

-1 

“1 

0 

0 

0 

0 

0~ 

1 

-1 

-1 

-1 

-1 

-1" 

1 

1  - 

t 

-1 

-1 

-t 

1 

1 

0 

0 

0 

0 

0 

2 

0 

0 

0 

0 

1 

1 

1 

-1 

-1 

-1 

= 

1 

1 

1 

0 

0 

0 

X 

0 

0 

2 

0 

0 

0 

1 

-1 

1 

1 

-1 

-1 

1 

0 

1 

1 

0 

0 

0 

0 

0 

2 

0 

0 

1 

1 

1 

-1 

1 

-1 

1 

1 

1 

0 

1 

0 

0 

0 

0 

0 

2 

0 

_  1 

-1  - 

1 

1 

1 

1 

-J 

0 

0 

1 

1 

1_ 

_0 

0 

0 

0 

0 

2 _ 

In  general,  t,  .  is  given  by  the  following  rules: 
=  1 

»-1  ( j  =*  2,  .  .  .  ,  n  ♦  1 ) 
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=  2  ^  =  2'  •  •  *  •  n  *  1 J 
t  =  0  (otherwise)* 

It  may  be  verified  that  T_1  has  the  following  form 

i  ^  i  •  *  * 

i  o  0  .  .  .  o 

o  i  o  .  .  .  o 

o  o  £  ...  o 

•  •  •  • 

*  •  •  • 

0  0  0  ij 

If  R  is  the  reduced  coefficient  matrix  for  a  one— at— a-time  design,  then  (a)  the 
first  column  of  R  consists  solely  of  I'a;  (b)  the  main  diagonal  of  R  consists 
of  1*s,  since  the  .ith  factor  appears  at  its  high  level  in  the  ( i+1 )st  run;  and 
(c)  the  elements  above  the  main  diagonal  are  all  0,  since  the  ith  factor  remains 
at  O  until  the  ( i+1 ) st  run.  Since  R  is  lower  triangular  and  has  1 *s  down  the 
main  diagonal,  the  determinant  of  R  is  unity.  Since  the  elements  of  R  are  inte¬ 
gers  any  minor  is  integral.  Since  the  elements  Of  an  inverse  are  by  definition  an 
appropriate  minor  divided  by  the  determinant  of  the  original  matrix,  R~’  also  con¬ 
sists  of  integers.  It  follows  from  the  form  of  T*1  that  each  element  of 
1  1  =  T~ 1  R~ '  must  be  a  multiple  of  •$-. 

THEQRQi  1.  For  a  one— a t-a- 1  ime  design  containing  n+1  runs  and  n  factors  at  two 

levels,  a  lower  bound  for  the  variance  of  any  estimate  is  io  . 

2 

PROOF.  The  variances  of  the  estimates  are  o  times  the  diagonal  elements  of 
(X'X)  1 .  Because  X  is  square  (X'X)  1  reduces  to  (X-1)(X_1)'  .  The  diagonal 
elements  are  therefore  the  suae  of  aquareB  of  the  elements  in  each  row  of  X-'  ,  We 
know  already  that  the  elements  of  X  are  all  multiples  of  The  sum  of  squares 
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of  the  elements  in  a  row  must  therefore  be  a  positive  multiple  of  If  the  value 

were  i-,  then  a;l  the  elements  would  be  zero  except  one  which  was  equal  to  4  . 

The  inner  product  of  a  row  of  X'1  and  a  column  of  X  must  of  course  be  either  0 
or  1 .  Since  the  elements  of  X  are  all  either  +1  or  -1 ,  the  inner  product  of 
any  column  of  X  with  a  row  containing  a  single  i  would  be  4  .  Therefore  a  lower 
bound  to  the  sum  of  squares  of  elements  of  any  row  of  X  1  is  and  the  theorem 

is  proved. 

CHARACTERIZATION  OP  OPTIMUM  ONE-AT-A-TIME  DESIGNS 

The  most  fa.uiliar  family  of  one-at-a-time  designs  are  those  in  which  each  factor 
returns  to  its  low  level  after  it  has  first  been  introduced.  The  general  form  of  the 
uatrices  R,  R_1,  and  X-1  in  this  family  are  exemplified  by  the  following  five- 
factor  Ci.se: 
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It  will  be  noted  that  the  variance  of  each  main-effect  estimates  is  to  ,  th j  theo- 

2  2 

-etioal  lower  bound.  The  variance  of  the  grand  mean  is  o  (n  -3n+4)/4  for  tie 
n-factor  case. 

It  is  of  interest  to  inquire  whether  or  not  there  is  a  family  of  designs  in 
which  the  variance  of  the  gre'nd  mean  is  also  at  the  minimum  level  of  The 

family  of  designs  in  which  each  factor  is  maintained  at  its  high  level  satisfies  this 
requirement.  Again  using  a  five-factor  example  to  illustrate  the  general  case,  R, 
R*' ,  and  X  '  are  as  follows: 
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These  two  classes  of  designs  are  two  extremes  in  which  all  factors  are  either  returned 

to  their  initial  level  or  are  held  at  their  new  level.  p.-tfc  classes  are  special  cases 

2 

of  a  more  general  class  of  one-at-a-time  designs,  al’  hich  havs  variances  of  -Jro 
for  all  the  main-effect  estimates.  This  class  consists  of  designs  in  which  for  every 
k  r  2  the  kth  run  differs  from  some  previous  run,  say  the  ^th  ,  only  in  the  level 
of  the  (k-1 )at  factor.  The  estimate  of  the  effect  cf  the  ( k— 1 )st  factor  is  1 
times  the  kth  response  minus  the  J^th  .  For  the  former  of  the  two  classes  pre- 

-  1  and  for  the  latter  5  k  .  This  heuristic  argument  will 

now  be  formalised. 


viously  discussed 


THEOREM  2.  In  a  one-at-a-time  design  the  variance  of  the  main  effect  of  a  two-lev -*1 

2 

factor  achieves  the  lower  bound  of  -jro  if  and  only  if  the  run  in  which  that  factor 
is  introduced  differs  from  some  previous  run  only  in  the  level  of  that  factor. 

PROOF.  The  variance  of  the  estimate  of  the  effect  of  the  (k-1 )st  factor  will  be 

2  j 

tc  if  an  only  if  the  kth  row  of  S  =  R  contains  a  single  nonzero  off-diagonal 
element,  which  must  be  equal  to  -1.  Assume  that  the  kth  row  of  S  is  of  this 
form  and  that  the  single  element  equal  to  -1  appears  in  the  _£th  column  (l  <  k)  . 
Thus  we  have  s^j  =  1,  =  1,  and  s^  =  0  for  i  4  &  and  j  f  k  .  Formal  multi¬ 

plication  of  the  kth  row  of  S  by  the  matrix  R  =  S  ^  yields  the  system  of  equa- 

ti0ns  Lm=13kmrmj  =  «kj  ’  which  reduce8  to  -rAj  +  rkj  =  *kj  •  wher*  ^  i8  the 
Kroneoker  6  .  It  follows  that  the  j£ta  and  kth  rows  of  R  are  identical  except 

for  the  value  corresponding  tc  the  level  of  the  (k-1 )st  factor. 
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Sow  uauss  that  the  ith  and  xth  rows  of  £  are  identical  except  that 

=*  0  and  rk|f  a  1.  Formal  multiplication  of  the  ^th  rows  of  B  by  the  columns 

of  S  yields  the  two  systems  of  equations  if1  ,  r ,  a  ,  =  6..  and  if5  ,  r,  s  .  = 

'  1  s=1  Am  mj  ij  a- 1  tea  aj  It  j 

Suba traction  of  the  foraer  from  the  latter  yields  ~  r|B^sBj  =  = 

or  s^  =  1 ,  s^ j  =  -1 ,  and  a^  *»  0  for  j  =  k  and  j  =  t  .  The  proof  is  now  com¬ 
plete  . 

Often  an  experimenter  may  prefer  to  determine  which  level  of  each  factor  ia  better, 
and  conduct  the  remaining  experiments  at  the  more  desirable  level.  Thus,  in  general 
after  a  factor  is  introduced  it  will  either  be  held  at  its  high  level  or  be  returned 
to  its  low  level  for  the  remainder  of  the  experiment.  It  can  be  verified  that  for  this 
type  of  design  the  conditions  of  Theorem  2  are  satisfied,  and  the  lower  bound  is 
achieved  for  er.ch  main-effect  estimate. 

In  the  kind  of  experiments  in  which  a  one-at-a— time  design  might  be  useful,  there 
may  or  may  not  be  interest  in  obtaining  a  good  estimate  for  the  grand  mean.  The  vari¬ 
ance  of  the  estimate  of  the  grand  mean  will  achieve  the  lower  bound  in  a  saturated 
design  only  if  the  treatment  combination  with  all  factor  at  their  high  levels  is  in  the 
design.  The  only  one-at-s-tiae  series  that  can  have  this  property  is  the  one  in  which 
all  factors  remain  at  their  high  levels. 

ONK-AT-A-TIKE  DESIGNS  FOR  MULTIPLE-I.EVEL  FACTORS 

The  results  for  two-level  factors  can  be  extended  to  the  case  in  which  each  factor 
may  have  sore  than  two  levels  fairly  easily  by  a  proper  choice  of  parameterization. 

For  a  factor  with  m  levels  there  are  m-1  parameters  necessary  to  describe  its 
response.  These  main-effect  parameters  are  defined  as  contrasts  among  the  expected 
responses  at  the  levels.  Let  the  levels  be  designated  by  n  ,p  , ...,p  ;  then  the 

•  c  11 

parameterization  will  be  01  =  i(u2  -  M,),  Bp  =  -  Uj) . -  U,)  - 

For  an  appropriate  definition  of  the  grand  mean,  the  coefficient  matrix  X  associated 
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Kith  this  parameterization  takes  the  fora  of  the  X  matrix  for  a  one-at-a-time 
design  for  m-1  tiro-level  factors.  Consider  one  five-level  factor.  'Hie  design 
with  one  run  at  each  level  has  the  X  matrix 
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It  is  apparent  that  this  is  identical  to  the  coefficient  matrix  for  a  one-at-a-time 
design  for  4  two- level  factors. 

In  many  practical  situation  an  experimenter  may  be  interested  in  comparisons 
other  than  binary  comparisons  between  the  levels.  For  example,  it  may  be  natural  to 
use  as  parameters  for  a  five-level  factor  (a)  a  comparison  of  the  average  response 
at  the  first  two  levels  with  the  average  response  at  the  last  three  levels,  (b)  an 
intercomparison  of  the  iirst  two  levels,  and  (o)  two  intercomparisons  of  the  last 
three  levels.  Given  any  such  specific  parameterization,  a  theorem  analogous  to 
Theorem  3  below  can  probably  be  proved.  In  order  to  avoid  a  commitment  to  a  special¬ 
ized  parameterization,  the  theorem  is  given  for  simple  binary  comparisons  only.  Other 
parame terizations  can  be  studied  by  resolving  them  into  simple  binary  comparisons. 
THEOREM  3'  Suppose  it  is  of  interest  to  estimate  ^  the  difference  between  the 
expected  responses  at  any  pair  of  levels  for  each  multi-level  factor.  Then  a  lower 
bound  for  the  variance  of  such  an  estimate  obtained  from  a  fully  saturated  one-at-a- 
time  design  is  -Jo 

PROOF.  By  convention  let  the  first  level  of  each  factor  be  the  one  used  in  the  first 
run.  In  the  proof  of  Theorem  1  it  was  shown  that  the  minimum  sum  of  squares  of  a 
row  of  X  1  is  achieved  when  the  row  has  two  nonzero  entries,  each  having  absolute 
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2 

value  i  .  This  suffices  to  prove  that  -jro  is  the  lower  hound  for  the  variance  of 
a  col  parison  of  any  level  with  the  first.  A  comparison  of  any  other  two  levels  ji 
and  is  the  difference  of  two  comparisons  8i  *  )  and  8^  = 

*  a 

The  variance  of  the  difference  8^  -  is  the  sum  of  the  variances  minus  twice  the 

covariance.  Since  the  rows  of  X'1  are  by  definition  orthogonal  to  the  first  column 

of  X  the  sum  of  the  elements  of  any  row  of  X'1 ,  except  the  first,  i3  zero.  Since 

the  elements  of  X  1  are  multiples  of  ?  ,  it  follows  that  each  row,  in  a  cense, 

contains  an  even  number  of  ^-'s.  The  variances  of  8.  and  0.  are  therefore  multi- 

*  J 

2 

pier,  of  io  .  Similarly,  the  covariances  between  0,  and  0.,  the  sum  of  cross 

*  J 

products  of  the  corresponding  rows  of  X-  ,  are  multiples  of  a/ 4.  It  follows  that 

V(§  )  +  V(8  )  -  2C(0  , 0  )  must  be  a  multiple  of  •  We  have  now  shown  that  the 

x  ,3  1  j 

variance  of  ^  the  difference  between  the  expected  responses  at  any  pair  of  levels 
2  2 

is  a  multiple  of  ,  so  that  the  minimum  value  is  -Jpo  ,  which  completes  the  proof. 

Theorem  2  once  again  can  be  used  to  characterize  the  class  of  designs  for  which 
the  bound  is  attained.  In  particular,  the  practice  of  maintaining  the  best  level  for 
each  factor  for  the  rest  of  the  experiment  will  result  in  an  optimum  design  for  main 
effects.  Note  that  it  is  permissible  for  intervening  factors  to  be  introduced  before 
all  the  levels  of  a  single  factor  are  considered. 

FACTORS  INTRODUCED  IN  BLOCKS 

One-at-a-tiae  designs  are  of  practical  importance  since  they  provide  a  means 
for  minimizing  the  impact  of  a  sudden  unexpected  termination  of  the  experiment  after 
any  run.  It  may  often  happen,  however,  that  the  experimenter  is  reasonably  sure  that 
a  block  of  runs  can  be  completed  before  it  is  likely  that  the  experiment  must  be  dis¬ 
continued.  In  such  cases  one  might  inquire  how  much  advantage  can  be  taken  of  the 
larger  block  size  to  improve  the  efficiency  of  the  design.  In  answering  this  question 
attention  will  be  confined  to  two-level  factors. 
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Previous  work  on  contractible  designs  has  been  done  under  the  assumption  that 
a  complete  block  could  be  completed  [3]*  In  that  work  a  new  factor  is  introduced  in 
a  block  of  runs  of  sufficient  size  that  all  interactions  with  old  factors  can  be 
estimated.  A  number  of  series  of  such  designs,  both  saturated  and  unaaturated,  have 
been  tabulated.  Of  necessity,  each  block  must  be  of  larger  size  than  the  previous. 

In  the  present  paper  we  limit  our  attention  to  fixed  block  sizes. 

Consider  first  the  case  in  which  each  factor  is  returned  to  its  low  level  after 
the  block  in  which  it  is  introduced  has  been  completed.  The  matrix  R  for  p  blocks 
ha3  the  following  form: 


*11  0 
r_  0  R„ 


The  inverse,  call  it  S,  is  of  the  same  form.  We  have  immediately 

S. .  =  R.^  and  s.  =  -S..r.  .  Note  that  the  elements  in  the  ith  block  of  the  inverse, 

li  n  i  li  i  “ 

hence  the  variances  of  the  estimates,  depend  only  on  the  ith  block  of  the  R  matrix. 
Therefore,  the  problem  of  minimizing  the  variances  using  blocks  of  size  k  is  equi¬ 
valent  to  minimizing  variances  in  complete  designs  of  size  k+1  .  It  was  shown  by 
Plackett  and  Burm&n  [5]  that  a  lower  bound  for  the  variances  is  c^/(k+l),  and  that  this 
bound  is  attainable  if  k+1  is  a  multiple  of  4  (the  case  k=2  1b  discussed  sepa¬ 
rately  in  a  subsequent  section). 

By  analogy  with  previous  results  (when  k=1  ),  one  would  expect  that  o^/(k+l) 

should  indeed  be  a  lower  b  und  for  variances  using  blocks  of  size  k.  Similarly,  by 


analogy  with  previous  results,  one  would  expect  that  for  k+1  a  multiple  of  4,  the 
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lower  bound  should  be  attained  if  factors  are  held  constant  after  the  clock  in  which 
they  are  first  introduced.  At  present  these  statements  are  only  conjectures.  The 
next  section  illustrates  why  it  nay  be  much  more  difficult  to  complete  the  proofs 
than  In  the  case  k=1 . 

Plackett-Burmar.  Blocks 

lie  will  be  most  concerned  with  blocks  of  size  3.  The  Plsckett-Burman  design  for 
three  factors  in  four  runs  is  as  follows! 


X  = 


1 

1 

1 

Jj 


-1  -1 

1  1 

1  -1 

-1  1 


-1 

1 

1 


If  the  submatrix  consisting  of  the  last  three  rows  and  columns  is  used  a3  a  block 
(which  we  shall  call  a  Plackett-Bunnan  block  of  size  3),  the  R  matrix  takes  the 
following  form! 


O' 

K 

R21 


O' 

0 

K 


O’ 

O 

O 


'  r 


where  K  is  the  matrix 


Pi 


K  = 


P2 


1  1 
1  0 
0  1 


The  matrix  R  =3  may  be  partitioned  in  the  same  way! 
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a  =  s  = 


o* 

_  « 

X.  ‘ 

s 

21 


O' 

0 

0 


.-1 


pi 


P2 


The  matrix  K 


-1 


is 


x-1- 


* 

* 


}  -4 

i 

t  J 

and  3^  =  -K  1r1  =  -(i.T.i)' 

variances  of  the  estimates  of  main  effects  are  all  4(i)2c2/4  =  q2/4.  How  suppose 


L-? 


i 


If  R  =0  for  i  >  j 


then  s.  =  s.  and  the 
l  1 


R^  =  J  for  i  >  j,  where  J  i3  a  3  x  3  matrix  all  of  whose  elements  are  unity. 
We  have  S21  -  -K  1JK-1  =  -J4,  s2  =  -X  1  r2~X  1  Js^  =  r^/4,  and  in  general  the  ele¬ 
ments  of  the  rows  in  the  successive  blocks  can  be  multiples  of  successively  higher 

powers  of  Note,  however,  that  the  variances  of  estimated  main  effects  from  the 

'2  2  2  2 

second  block  are  L3(?)  +  4(-J)  ]o  /4  =  a  /A  .  Similarly,  the  variances  remain  at 

2 

0/4  for  the  main  effects  of  factors  in  later  blocks,  even  though  the  number  of 
nonzero  entries  increases  with  each  successive  block.  For  this  reason,  the  simple 
proof  of  Theorem  1  will  not  generalize  directly  and  thus  a  proof  that  cj2/4  is  in 
fact  the  minimum  variance  will  involve  treating  a  number  of  special  cases. 

The  picture  for  blocks  of  larger  size  is  quite  similar.  For  k=7  each 
diagonal  block  of  the  R  matrix  has  the  form 


45 


The  elsmenta  of  the  inverse  of  this  matrix  are  and  s1  =  -r?/4.  In  general  the 

elements  of  S21  are  multiples  of  l/l6,  the  elements  of  are  multiples  of  l/64, 

etc.  The  variances  appear  to  have  the  minimum  value  of  )/&  whenever  factors  are  all 
held  constant  after  the  block  in  which  they  are  introduced. 

Blocks  of  Size  Two 

Unfortunately,  nothing  is  gained  by  introducing  factors  two  at  a  time  over  intro¬ 
ducing  them  one  at  a  time.  This  can  be  demonstrated  considering  the  class  of  all  non- 
singular  2x2  matrices  whose  elements  are  0  and  1 .  Apart  from  permutations  of 
rows  and  columns,  this  class  consists  of  only  two  elements: 

o-j  n  0-] 

j  u  .  L°  *J  * 


Since  these  matrices  are  themselves  lower  triangular,  and  R  matrix  employing  blocks 
of  size  two  is  of  exactly  the  same  form  as  the  R  matrix  for  blocks  of  size  one. 
Therefore,  the  same  variance  bound  applies  to  blocks  of  size  two  as  to  blocks  of  size 
one. 

Blocks  of  Size  Four 

It  can  be  shown  by  an  enumeration  of  possible  designs  that,  for  studying  4  two- 
level  factors  in  5  runs,  the  design  whose  R  matrix  is 


46 


10  0  0  0 

11110 
1110  1 
110  11 
_1  0  1  1  1_ 

simultaneously  minimizes  the  variances  of  the  estimates.  Therefore,  designs  using 
as  blocks  the  'natrix 


K4  = 


1  1  1 
1  1  0 
1  0  1 
0  1  1 


would  appear  to  be  of  primary  interest.  The  variances  of  estimates  of  factors  in 


obtained 

from 

1/3 

1/3 

1/3 

-2/3 

K-1  = 

1/3 

1/3 

-2/3 

1/3 

4 

1/3 

-2/3 

i/3 

l/5 

-2/3 

1/3 

1/3 

1/3 

- 

are  ( ' 

/4  x  8/9) 

2 

a  = 

2o2/9, 

which  is 

and  b1  =  -rj/3, 

2 

with  blocks  of  size  3«  Note  that  2a  /S  is  larger  than  the  theoretical  lower  bound 
2  2 

of  a  Ak* l)  *  o  / 5»  that  bound  is  not  attainable  for  4  factor  five-run  designs. 

By  analogy  with  previous  results,  one  would  expect  that  as  long  aa  factora  are 
held  fixed  after  the  block  in  which  they  are  introduced,  the  variances  of  effects  of 
factors  in  successive  blocks  would  continue  to  have  the  same  variance.  Such  is 
certainly  the  case  if  all  factors  are  returned  to  their  low  level.  Surprisingly,  if 
some  or  all  factors  are  held  at  their  high  level,  variances  actually  decrease  in  sub¬ 
sequent  blocks.  In  the  next  paragraph  variances  are  derived  as  a  function  of  block 
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nusber  when  all  factors  are  held  at  their  high  level, 


-1 


As  previously  we  will  partition  R  and  S  «  R  in  the  fom: 


1 

r. 


LrP 


O’ 

R 


1 1 


21 


pi 


O' 

0 


22 


P2 


O’ 

0 


£ 


PP 


L*p 


1 1 


'21 


pi 


0‘ 

0 


22 


P2 


O’ 

O 


PP  _J 


where  the  vectors  r^  =  (l,1,1»l)*  as  usual.  We  are  examining  the  case  in  which 


1. .  =  K.  and  R.  .  =  J. ,  for  i  >  j,  where 
li  4  lj  4 


J  is  the  4X4  matrix  all  of  whose 


elements  are  unity  (the  subscripts  4  will  be  dropped).  It  is  obviouB  that  S. 


ii 


is  equal  to  K 


-1 


It  will  now  be  shown  that 


st  »  (-l/3)irJ ,  and 


3ij  = 

Formally  multiplying 


i  “lAj  -  V  > 

k«i 


for  i  >  j  . 

R  by  S,  we  obtain  the  equations 
1  s  i  -c  p 

1  <  i  <  j  <  p  , 
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where  6^  ia  the  Kronecker  6.  Substituting  the  values  of  and  a^  into 

the  left  side  of  the  first  equation,  we  obtain 

r  4  *S  (-l/3)kJr  *  (-l/?)1*!-  . 

Since  Jr^  =  4r^  and  Kr(  =  3 r^ ,  we  have 

[l  +  4  "S  (-l/3)k  ♦  3{-t/3)i]r1 
L-t 
k~1 


-  {1  ♦  (-i)[l-(-l/3)1"1]  +  3(-l /3)i}r1  =  0. 


The  second  of  the  above  equations  nay  be  verified  by  a  similar  substitution  for 


R.,  and  S. 
lk  kj 


The  variance  of  a  main  effect  of  a  factor  in  the  ith  block  is  r  /4 


times  the  sum  of  squares  of  the  elements  in  the  rows  of  a^,  S^,  S^. 

This  sum  of  squares  is  (j/9)1  +  4(1/9)*  **+1  +  7/y,  which  equals 


[15  ♦  (1/9)^  M/18-  The  variances,  as  a  function  of  i,  are  as  follows: 


i 

1 

1 

2 

3 

00 

variance 

•  2222cr2 

•2098a2 

•2085o2 

•2083o2 

Note  that  the  asymptotic  variance  is  still  larger  thun  the  conjectured  lower  bound 

of  o2/5  . 


TREATING  INTERACTIONS  IN  DESIGN  .FOR  TWO-LEVE],  FACTORS 

Interactions  between  any  2  two-level  factorc  may  be  included  in  the  model  by 
inclusion  of  a  single  additional  run.  In  this  section  it  ia  shown  that  the  variance 
of  each  intsrftncacn  estimate  is  io  and  that  the  variance  of  each  main  effect  which 
is  included  in  an  interaction  is  reduced  to 
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The  reduced  coefficient  matrix  R  for  designs  containing  interactions  will  be 
constructed  in  a  lowei  triangular  form  so  as  to  take  advantage  of  previous  results 
in  this  paper.  The  portion  of  the  R  matrix  relevant  to  two  factors  has  one  of 
the  two  forms 


“l 

0 

o' 

0 

<r 

1 

1 

0 

1 

1 

0 

_1 

0 

or 

4 

i 

1 

In  order  to  estimate  the  interaction  between  the  two  factors  it  is  necessary  to 
introduce  the  fourth  possible  combination  of  levels  for  the  two  factors.  The  inter¬ 
action  will  be  assigned  the  value  1  in  the  R  matrix  when  the  fourth  combination 
appears  and  0  for  the  other  three  combinations.  Thus,  the  portion  of  R  corre¬ 
sponding  to  two  factors  and  their  interaction  has  one  of  the  two  forms 


0 

0 

<r 

"T 

0 

0 

<r 

i 

1 

0 

0 

or 

B(2) 

i 

i 

0 

0 

i 

0 

1 

0 

R  ~ 

i 

i 

1 

0 

j 

1 

1 

1_ 

j. 

0 

1 

1_ 

These  are  related  to  the  traditional  coefficient  matrices  through  trianguler  trans¬ 
formation  matrices  as  followst 


1 

-1 

-1 

r 

~ 

0 

0 

5“ 

1 

-1 

-1 

T 

1 

1 

-1 

-i 

a* 

i 

i 

0 

0 

X 

0 

2 

0 

-2 

1 

-1 

1 

i 

0 

1 

0 

0 

0 

2 

-2 

J 

1 

1 

i_ 

J 

1 

1 

1__ 

JJ 

0 

0 

4. 

X 


1 

-1 

-1 

1 

“T 

0 

0 

0" 

1 

-1 

-1 

f 

1 

1 

-1 

1 

1 

0 

0 

0 

? 

0 

-2 

1 

1 

1 

“ 

1 

1 

1 

0 

X 

0 

0 

2 

4L 

_1 

-1 

1 

J 

0 

1 

1_ 

_0 

0 

0 

r(2)t(2> 
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The  inverses  of  these  transformation  matrices  are  respectively 


"i  i  I 

fT(l)r1  ,  0  *  °  * 

(  }  0  o  -J-  i 

o  o  o  i 


o  i  1  o  -J-  0 

,  i  and  (t^r1-  0  0  *  * 


i  i  i  ** 


0  0  o  I  . 


The  transformation  matrices  for  general  one-at-a-time  designs  containing  n 
factors,  m  interactions,  and  n  +  m  +  1  runs  are  of  the  general  form 

*11  =  1 

t^j  —  —1  (j  —  2, . . .  ,n  +  l) 

tlj  =  1  (j  =  n  +  2, . . , ,n  +  m  +  l) 

t^^  =*  2  (j  —  2, . . .  ,n  +  l) 

t^  =  *4  (j  =  n  2,  • . .  ,n  +  m  +  l) 

t.  =  ±2  (j  =  n  +  2,...,n  +  m  +  1  and  the  (i-1 )at  factor  is  involved  in 
^  J 

the  interaction  corresponding  to  the  jth  column) 
t^  =  0  (otherwise). 

The  elements  of  V  =  T-1  are  of  the  general  form 
V11  =  1 

vij  “  *  “  2”**’n  +  0 

vij  *  ^  (j  "n  +  2’*~'n  +  1  } 

VjJ  “*  (J  ”2 . n+  0 

(j  a  n  +  2,...,n  +  m  +  l) 

v  «  (j  =  n  +  2,...,n  +  m  +  1  and  the  (i-1 )st  factor  is  involved  in 
the  interaction  corresponding  to  the  ^.th  column) 
v..  ■  0  (otherwise). 

*"  2  - 
Since  the  variance  of  an  estimated  parameter  is  o  times  the  sum  of  squares  or 

the  elements  of  a  row  of  X-1  -  T'V1,  and  since  T”1  contains  elements  as  small 

as  i,  an  argument  like  that  used  to  prove  Theorem  1  can  be  used  to  show  that  a 


•  '  i  St,., 
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variance  coaid  have  a  value  as  low  aa  "^o  •  For  those  factors  whic.i  are  involved  in 

no  interaction,  however,  the  corresponding  row  of  T-1  contains  only  the  values  \ 

and  0,  so  that  the  variance  bound  is  the  same  aa  before. 

It  remains  to  determine  whether  or  not  designs  exist  for  which  the  bound  of 
is  attained.  Once  again  the  answer  is  in  the  affirmative,  and  those  designs  for 

which  factors  are  returned  to  their  low  levels  after  their  initial  introduction  except 

for  runs  in  which  they  are  involved  in  the  interaction  have  the  optimum  property. 

As  an  example,  consider  a  design  for  estimating  the  effects  of  four  factors  and  the 

interactions  between  the  first  and  third  and  third  and  fourth.  The  R  matrix  for 

auch  a  design  is  co  follows: 


1 

1 

1 

1 


0  0  0  0  0 

10  0  0  0 

0  10  0  0 

0  0  10  0 

0  0  110 

10  10  1 

o  o  o  ;  o 


o' 

0 

0 

0 

0 

0 

1 


The  matrix  is  easily  inverted  to  obtain 


3 


1 

-1 

-1 

-1 

0 


0 

1 

0 

0 

0 


1  -1 
-1  0 


0 

0 

1 

0 

0 

0 

0 


0 

0 

0 

1 

-1 

-1 

1 


0 

0 

0 

0 

1 

0 

-1 


0 

0 

0 

0 

0 

1 

0 


fff 

0 

0 

0 

0 

0 

1 


which  when  multiplied  by  T-1  yields 


“i  i  *  0  i  i  i 

-■$  i  0  0  0 

-i  o  I  o  o  o  o 

x-1-  o  --*  o  o  i  i  -i 

-i  0  0  “-y  i  0  i 

i  -i  0  -i  0  i  0 

_-i  o  o  i  -i  o  ± 

The  variance  of  the  interaction  estimates  and  of  the  main-effect  estimates  ere  all 
■jta  except  for  the  factor  which  is  involved  in  no  interaction,  for  which  the  vari¬ 
ance  ia 

A  WORD  OF  WARNING 

It  has  been  the  purpose  of  this  paper  to  oresent  general  results  on  saturated 
sequential  designs  such  as  one-at-a-time  designs.  It  will  be  appropriate,  however, 
to  make  a  few  observations  on  their  limitations. 

By  their  very  nature,  the  designs  discussed  have  all  their  degrees  of  freedom 
used  in  estimating  effect  parameters,  so  that  no  internal  error  estimate  is  avail¬ 
able.  Sometimes  this  may  be  no  particular  disadvantage.  Either  a  good  error  esti¬ 
mate  is  available  from  prior  experience,  or  it  is  not  required  of  the  experiment  to 
test  the  significance  the  parameter  estimates  relative  to  the  error.  Alternatively, 
the  half-normal  plotting  procedure,  clue  to  Daniel  [6],  may  be  used  if  only  a  few  of 
the  factors  are  expected  to  have  real  effects. 

Since  the  runs  are  conducted  in  a  sequential  fashion,  with  the  possibility  of 
altering  the  experiment  between  runs,  there  ia  no  opportunity  to  obtain  a  complete 
randomization  of  the  order  of  the  runs.  Rather  than  attempting  to  obtain  a  "partial 
randomization"  by,  for  example,  randomizing  the  order  of  introduction  of  some  of  the 
factors,  the  experimenter  should  Introduce  the  factors  in  the  order  of  their  potential 
importance.  It  ia  obvious  that  in  the  absence  of  a  complete  randomisation,  there  is 
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no  basis  for  the  validity  of  testa  for  significance  of  the  estimated  effects.  Thus, 
these  designs  do  not  provide  a  statistical  proof  of  the  reality  of  effects.  They 
will,  however,  give  an  indication  of  what  are  apt  to  be  the  most  important  factors. 

A  standard  design,  fully  randomized,  car.  be  run  subsequently  in  order  to  provide 
valid  significance  tests. 
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II  abstnact 

'he  report  consists  of  three  distinct  but  related  papers.  The  first  is  concerned 
lith  methods  for  constructing  designs  to  aeet  realistic  requirements  on  the  mue 
isr  of  runs  and  with  criteria  for  selecting  a  design  from  a  number  of  alternative 
xaaples  of  various  construction  techniques  are  illustrated  and  designs  are  given 
hich  were  constructed  for  actual  experiments.  Two  specific  numerical  criteria 
ire  developed,  and  a  convenient  computer  routine  for  evaluating  them  is  described 

he  second  paper  discusses  designs  of  even  resolution.  It  is  shown  that  the  saal 
at  resolution  4  designs  for  n  factors  at  two  levels  must  contain  at  least  2n 
una,  and  that  "foldover"  designs  are  available  with  2n  runs.  It  ia  conjecture 
hat  the  only  ainimal  resolution  4  designs  are  foldover  designs.  The  case  of 
esolutlon  6  designs  is  also  discussed. 

he  third  paper  gives  the  variance  bounds  for  estimate«of  main  effects  using  one- 
i- a- time  designs,  and  characterise*  those  designs  which  achieve  the  lower  bounds 
ituatlona  in  which  runs  arm  conducted  a  block  at  a  time  (rather  than  singly) 
re  treated  end  it  Is  shown  that  inclusion  of  interaction  terms  in  the  model 
proves  the  main-effect  estimates  of  factors  involved  in  the  interactions. /  ) 
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